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Abstract 

We establish general theorems quantifying the notion of recurrence — 
through an estimation of the moments of passage times — for irreducible 
continuous-time Markov chains on countably infinite state spaces. Sharp 
conditions of occurrence of the phenomenon of explosion are also ob- 
tained. A new phenomenon of implosion is introduced and sharp condi- 
tions for its occurrence are proven. The general results are illustrated by 
treating models having a difficult behaviour even in discrete time. 

Resume 

Nous etablissons des theoremes generaux qui quantifient la notion de 
recurrence — a travers Festimation des moments de temps de passage — 
pour des chaines de Markov a temps continu sur des espaces d'etats de- 
nombrablement infinis. Des conditions fines garantissant I'apparition du 
phenomene d'explosion sont obtenues. Un nouveau phenomene d'im- 
plosion est introduit et des conditions fines pour son apparition sont aussi 
demontrees. Les resultats generaux sont illustres sur des modeles ayant 
un comportement non-trivial meme lorsqu'ils sont consideres en temps 
discret. 
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1 Introduction, notation, and main results 



1.1 Introduction 

In this paper we establish general theorems quantifying the notion of recur- 
rence — by studying which moments of the passage time exist — for irreducible 
continuous-time Markov chains ^ = f) fe[o,oo[ on a countable space X in critical 
regimes. 

Models of discrete-time Markov chains with non-trivial behaviour include 
reflected random walks in wedges of dimension d = 2 [I, 5, 12], Lamperti pro- 
cesses [10, 11], etc. These chains exhibit strange polynomial behaviour. In the 
null recurrent case some (but not all) moments of the random time needed to 
reach a finite set are obtained by transforming the discrete-time Markov chain 
into a discrete-time semimartingale via its mapping through a Lyapunov func- 
tion [5]. 

There exist in the literature powerful theorems [1], applicable to discrete- 
time critical Markov chains, allowing to determine which moments of the pas- 
sage time exist. Beyond their theoretical interest, such results can be used to 
estimate the decay of the stationary measure [14], and even the speed of con- 
vergence towards the stationary measure. The first aim of this paper is to show 
that theorems concerning moments of passage times can be usefully and in- 
strumentally extended to the continuous time situation. 

Continuous-time Markov chains have an additional feature compared to 
discrete-time ones, namely, on each visited state they spend a random holding 
time (exponentially distributed) defined as the difference between successive 
jump times. We consider the space inhomogeneous situation where the para- 
meters Yx £ of the exponential holding times (the inverse of their expecta- 
tion) are unbounded, i.e. sup^^x Tx = In such situations, the phenomenon 
of explosion can occur for transient chains. Chung [2] has established that the 
condition Z^=i l''Tf„ < +00- where |„ is the position of the chain immediately 
after the n-th jump has occurred, is equivalent to explosion. However this con- 
dition is very difficult to check since is global i.e. requires the knowledge of the 
entire trajectory of the embedded Markov chain. Later, sufficient conditions 
for explosion — whose validity can be verified by local estimates — have been 
introduced. Sufficiently sharp conditions of explosion and non-explosion, ap- 
plicable only to Markov chains on countably infinite subsets of non-negative 
reals, are given in [7, 8] . In [ 18] , a sufficient condition of explosion is established 
for Markov chains on general countable sets; similar sufficient conditions of ex- 
plosion are established in [19] for Markov chains on locally compact separable 
metric spaces. 

The second aim of this paper is to show that the phenomenon of explosion 
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can also be sharply studied by the use of Lyapunov functions and to establish 
locally verifiable conditions for explosion/non explosion for Markov chains on 
arbitrary graphs. This method is applied to models that even without explo- 
sion are difficult to study. More fundamentally the development of the semi- 
martingale method has been largely inspired with these specific critical models 
in mind (such as the cascade of fc-critically transient Lamperti models or of re- 
flected random walks on quarter planes) that seem refractory to known meth- 
ods. 

Finally we demonstrate a new phenomenon, we termed implosion (see defin- 
ition 1 . 1 below) , reminiscent of the Doblin's condition for general Markov chains 
[3], occurring in the case sup^^^Tx = oo- show that this phenomenon can 
also be explored with the help of Lyapunov functions. 



1.2 Notation 

Throughout this paper, X denotes the state space of our Markov chains; it 
denotes an abstract denumerably infinite set, equipped with its full cr-algebra 
5^ = ^(X). It is worth stressing here that, generally, this space is not natur- 
ally partially ordered. The graph whose edges are the ones induced by the 
stochastic matrix, when equipped with the natural graph metric on X need 
not be isometrically embedable into Z"^ for some d. Since the definition of a 
continuous-time Markov chain on a denumerable set is standard (see [2], for 
instance), we introduce below its usual equivalent description in terms of hold- 
ing times and embedded Markov chain merely for the purpose of establishing 
our notation. 

Denote by F = {Txy)x,y£X the generator of the continuous Markov chain, 
namely the matrix satisf^ng: Txy>Oify^x and T^x = "Tx. where jx = Lyewix} ^xy 
We assume that for all x e X, we have jx < oo. 

We construct a stochastic Markovian matrix P - {Pxy^x,y£.x out of F by de- 
fining 

V^A^f l-^'^l fory,., and P„=|° 

[ if Tx = 0, I 1 if rx = 0. 

The kernel P defines a discrete-time (X,P) -Markov chain I - dninm termed 
the Markov chain embedded at the moments of jumps. To avoid irrelevant com- 
plications, we always assume that this Markov chain is irreducible. 

Define a sequence a - (o'„)„>i of random holding times distributed, condi- 
tionally on I, according to an exponential law. More precisely, consider 

P[an^ds\0 =r^^^exp(-57^^^)liR^(5)(i5, n> 1, 



3 



so that E[an\0 = 1^7|„_i- The sequence / = (/„)„eN of random jump times is 
defined accordingly hj Jo - and for n > 1 by /„ = cTyt. The life time is 
denoted ( - lim„^co /« and we say that the (not yet defined continuous-time) 
Markov chain explodes on < oo}, while it does not explode (or is regular, or 
conservative) on = oo}. 

Remark . The parameter must be interpreted as the proper frequency of 
the internal clock of the Markov chain multiplicatively modulating the local 
speed of the chain. We always assume that for all x e X, < < oo- The case 
< 7 := infjcexTx ^ sup^^x =: T < oo is elementary because the chain can be 
stochastically controlled by two Markov chains whose internal clocks tick re- 
spectively at constant pace 7 and 7. Therefore the sole interesting cases are 

- sup^ Yx - 00: the internal clock ticks unboundedly fast (leading to an un- 
bounded local speed of the chain), 

- infjc7x = 0: the internal clock ticks arbitrarily slowly (leading to a local 
speed that can be arbitrarily close to 0). 

To have a unified description of both explosive and non-explosive processes, 
we can extend the state space into X = X u {5} by adjoining a special absorb- 
ing state d. The continuous-time Markov chain is then the cadlag process ^ = 
(^t)fe[o,oo[ defined by 

f _? ^ _ J I^«eNL]i[/„J„,i[(f) forO<f<C 

^0-^0 and g 

Note that although X is merely a set (i.e. no internal composition rule is defined 
on it), the above "sum" is well-defined since for every fixed t only one term sur- 
vives. We refer the reader to standard texts (for instance [2, 16]) for the proof 
of the equivalence between ^ and (|,/). The natural right continuous filtration 
('^f)te[o,+oo[ is defined as usual through = <^i^s '■ s< t); similarly = cr(^^ : 
5 < t), and = cr(|fc, k < n) for n e N. For an arbitrary (^f)-stopping time t, 
we denote as usual its past cr-algebra = {Ae : An{T < t} e ^t) and its 
strict past cr-algebra - a{A r\{t <r};t >0,Ae v ^q. Since it is imme- 
diate to show that t is -measurable, we conclude that the only information 
contained in =^/„+i but not in =^/„+i- is contained within the random variable 
i.e. the position where the chain jumps at the moment Jn+i- 
If Ae StC, we denote by Ta = inf{? > : g A} the (=^f) -stopping time of 
reaching A. 

A dual notion to explosion is that of implosion: 

Definition 1.1. Let (^ f) fe[o,oo[ be a continuous-time Markov chain on X and let 
A c X be a proper subset of X. We say that the Markov chain implodes towards 
Aif3K>0:yxeA',Ex[TA)<K. 
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Remark . It will be shown in proposition 2.11 that in the case the set A is finite 
and the chain is irreducible, implosion towards A means implosion towards 
any state. In this situation, we speak about implosion of the chain. 

It is worth noticing that some other definitions of implosion can be intro- 
duced; all convey the same idea of reaching a finite set from an arbitrary initial 
point within a random time that can be uniformly (in the initial point) bounded 
in some appropriate stochastic sense. We stick at the form introduced in the 
previous definition because it is easier to establish necessary and sufficient 
conditions for its occurrence and is easier to illustrate on specific problems (see 
§3). 

We use the notational conventions of [17] to denote measurable functions, 
namely mS^ = {/ : X ^ U\f is ^-measurable} with all possible decorations: 
bS^ to denote bounded measurable functions, mS^+ to denote non-negative 
measurable functions, etc. For / g mS^+ and a > 0, we denote by Saif) the 
sublevel set of / of height a defined by 

S«(/):={xGX:/(x)<a}. 

We recall that a function / g m3C+ is unbounded if ^ViVxexf^^^ - while 
tends to infinity (/ oo) when for every n g N the sublevel set Si/„(/) is finite. 
Measurable functions / defined on X can be extended to functions /, defined 
on X, by /(x) = /(x) for all x g X and f{d) :- (with obvious extension of the 
(j-algebra). 

We denote by Dom(r) = {/ g mS^ : Iyex\{xi ^xy\fiy)\ < +oo, Vx g X} the do- 
main of the generator and by Dom+(r) the set of non-negative functions in the 
domain. The action of the generator F on / g Dom(r) reads then: F/(x) := 

Lyex'^xyfiy)- 

1.3 Main results 

We recall once more that in the whole paper we make the following 

Global assumption 1.2. The chain embedded at the moments of jumps is ir- 
reducible and < 7x < oo for all x g X. 

We are now in position to state our main results concerning the use of Lya- 
punov function to obtain, through semimartingale theorems, precise and loc- 
ally verifiable conditions on the parameters of the chain allowing us to establish 
existence or non-existence of moments of passage times, explosion or implo- 
sion phenomena. The proofs of these results are given in section 2; the section 
3 treats some critical models (especially 3.1 and 3.3) that are difficult to study 
even in discrete time, illustrating thus both the power of our methods and giv- 
ing specific examples on how to use them. 
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1 .3. 1 Existence or non-existence of moments of passage times 

Theorem 1.3. Let f eDom+iT] be such that f ^ oo. 

1 . If there exist constants a > 0, c> and p>0 such that g Dom+ (T) and 

r/P(x)<-c/p-2(x),vx^s«(/), 

then Exirt ,fj < +oo for all q < p/2 and all xe X. 

2. Letg e mSC+. If there exist 

(a) aconstantb>0 suchthat f <bg, 

(b) constants a > and ci > such thatTgix) > -ci forx^ Saig), 

(c) constants C2 > andr > 1 such thatg^ e Dom(r) andFg' (x) < C2g'~^{x) 
forx^Salg), and 

(d) a constant p > such that f^ g Dom(r) andTfP > for x ^ 5abif)> 
thenExir^^ = +oo for all q > p andallx^Saif)- 

In many cases, the function g, whose existence is assumed in statement 2, of 
the above theorem can be chosen as g = / (with obviously = 1). In such situ- 
ations we have to check Tf < C2f^~^ for some r > 1 and find a p > such that 
r/P > on the appropriate sets. However, in the case of the problem studied in 
§3.3, for instance, the full-fledged version of the previous theorem is needed. 

Note that the conditions / e Dom+(r) and fP e Dom+(r) for some p > Q 
holding simultaneously imply that g Dom+(r) for all q in the interval with 
end points 1 and p. When ta is integrable, the chain is positive recurrent. In the 
null recurrent situation however, j a is almost surely finite but not integrable; 
nevertheless, some fractional moments E(t^) with q < \ can exist. Similarly, in 
the positive recurrent case, some higher moments E(t^) with q> \ may fail to 
exist. 

When p - 2, the first statement in the above theorem 1.3 simplifies to the 
following: if r/(x) < -e, for some e > and for x outside a finite set F, then the 
passage time E^Ct^) < oo for all x g X and all fjf < 1. As a matter of fact, in this 
situation, we have a stronger result, expressed in the form of the following 

Theorem 1.4. The following are equivalent: 

1. The chain is positive recurrent. 

2. There exist a function f e Dom+(r), aconstanto and a finite set F such 
thatTfix) < -e for allx^F. 
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Obviously, positive recurrence implies a fortiori that Exirp) < oo. 

If only establishing occurrence of recurrence or transience is sought, the 
first generalisation of Foster's criteria to the continuous -time case was given in 
the unpublished technical report [15]. Notice however that the method in that 
paper is subjected to the same important restriction as in the original paper of 
Foster [6], namely the semi-martingale condition must be verified everywhere 
but in one point. 

If Yx is bounded away from and oo, then since the Markov chain can be 
stochastically controlled by two Markov chains with constant jx reading re- 
spectively Yx = T Yx = T for all x, the previous result is the straightforward 
generalisation of the theorems 1 and 2 of [1] established in the case of discrete 
time; as a matter of fact, in the case of constant jx, the complete behaviour of 
the continuous time process is encoded solely into the jump chain and since 
results in [1] were optimal, the present theorem introduces no improvement. 
Only the interesting cases of sup^^x Tx = oo or inf^ex Tx = are studied in the 
sequel; the models studied in §3, illustrate how the theorem can be used in crit- 
ical cases to obtain locally verifiable conditions of existence/non-existence of 
moments of reaching times. The process Xf = /(^f), the image of the Markov 
chain through the Lyapunov function /, can be shown to be a semimartingale; 
therefore, the semimartingale approach will prove instrumental as was the case 
in discrete time chains. 

1.3.2 Explosion 

The next results concern explosion obtained again using Lyapunov func- 
tions. It is worth noting that although explosion can only occur in the transient 
case, the next result is strongly reminiscent of the Foster's criterion [6] for pos- 
itive recurrence! 

Theorem 1.5. The following are equivalent: 

1. There exist f e Dom+ (F) strictly positive ande > such thatTfix) < -efor 
allxe X. 

2. The explosion time ( satisfies Ex( < +oo for allxeX. 

Remark . Comparison of statements 1 of theorem 1.3 and 1 of theorem 1.5 de- 
mands some comments. The conditions of theorem 1.3 imply that Saif) is a 
finite set and necessarily not empty. For p = 2 and F = f^, the condition reads 
FF(x) < -e outside some finite set and this implies recurrence. In theorem 1.5 
the condtion Tf < -e must hold everywhere and this implies transience. 

The one-side implication [r/(x) < -e, Vx] Wxii^ < +oo) - 1, Vx] is already 
established, for / > 0, in the second part of theorem 4.3.6 of [18]. Here, modulo 
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the (seemingly) slightly more stringent requirement / > 0, we strengthen the 
result from almost sure finiteness to integrability and prove equivalence instead 
of mere implication. 

Proposition 1.6. Let f e Dom+(r) be a strictly positive bounded function and 
denote b - sup^^^ f^^^'> assume there exists an increasing — not necessarily strictly 
— function g : IR+ \ {0} ^ IR+ \ {0} such that its inverse has an integrable singularity 
at 0, i.e. f^ -^dy < oo. If we have Tf{x) < -g(/(x)) for all xeX, then Ex( < oo 
for all X. 

The previous proposition, although stating the conditions on Tf quite dif- 
ferently than in theorem 1.5, will be shown to follow from the former. This pro- 
position is interesting only when inf^ex g ° fM = because then the condition 
required in 1.6 is weaker than the uniform requirement r/(x) < -e for all x of 
theorem 1.5. 

If for some x e X, explosion (i.e. Pjc(C < +oo) > 0) occurs, irreducibility of the 
chain implies that the process remains explosive for all starting points x g X. 
However, since the phenomenon of explosion can only occur in the transient 
case, examples (see §3.4) can be constructed with non-trivial tail boundary so 
that for some initial x g X, we have both < Px(C < +oo) < 1- Additionally, the 
previous theorems established conditions that guarantee Ex( < oo (implying 
explosion). However examples are constructed where PxiC - oo) =0 (explosion 
does not occur) while E^C - oo. It is therefore important to have results on con- 
ditional explosion. 

Theorem 1.7. Let A be a proper (finite or infinite) subset ofX and f e Dom+ (F) 
such that 

- there exists Xq^A with /(xq) < infj^eA fM, 

- r/(x) < -e on A'' 
Then Exi(\rA = oo) < oo. 

The previous results (theorems 1.5 and 1.7) — through unconditional or 
conditional integrability of the explosion time C — give conditions establish- 
ing explosion. For the theorem 1.5 these conditions are even necessary and 
sufficient. It is nevertheless extremely difficult in general to prove that a func- 
tion satisfying the conditions of the theorems does not exist. We need there- 
fore a more manageable criterion guaranteeing non-explosion. Such a result is 
provided by the following 

Theorem 1.8. Let f eDom+{T). If 

- f^oo, 
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- there exists an increasing (not necessarily strictly) function g : IR+ ^ [R+ 
whose inverse is locally integrable but has non integrable tail (i.e. G{z) := 
Jq < +00 for all ze IR+ but\imz^ooG{z) = 00), and 

- r/(x) < g(/(x)) for all xe X, 
then Pxi( = +00) = 1 for all xeX. 

The idea of the proof of the theorem 1.8 relies on the intuitive idea that if 
fix) < g(/(x)) for all X, then E(/(Xf )) cannot grow very fast with time and since 
/ ^ 00 the process itself cannot grow fast either. The same idea has been used 
in [4] to prove non-explosion for Markov chains on metric separable spaces. 
Our result relies on the powerful ideas developed in the proof of theorems 1 
and 2 of [8] and of theorem 4. 1 of [4] but improves the original results in several 
respects. In first place, our result is valid on arbitrary denumerably infinite state 
spaces X (not necessarily subsets of IR); in particular, it can cope with models 
on higher dimensional lattices (like random walks in Z"^ or reflected random 
walks in quadrants). Additionally, even for processes on denumerably infinite 
subsets of IR, our result covers critical regimes such as those exhibited by the 
Lamperti model (see §3.1), a "crash test" model, recalcitrant to the methods of 
[8]. 

1.3.3 Implosion 

Finally, we state results about implosion. 

Theorem 1.9. Suppose the embedded chain is recurrent. 

1 . The following are equivalent: 

- There exist a function f e Dom+(r) such that swp^^-^fix) = b < 00, an 
a g]0, b[, such thatSaif) is finite, and ane>0 such that 

x^5aif)^Tfix)<-e. 

- For every finite AeS^, there exists a constant C := > such that 

x^A^ ExTa < C, 

(hence there is implosion towards A and subsequently the chain is im- 
plosive). 

2. Let f e Dom+(r) be such that f ^ 00 and assume there exist constants 
a> 0, 0, e > 0, and r > I such that f e Dom+(r). If further 

- r/(x) > -e,forallx^Saif), and 

- Yf{x)<cf'-\x),forallx^5a{f), 

then the chain does not implode towards Saif). 
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We conclude this section by the following 

Proposition 1.10. Suppose the embedded chain is recurrent. LetfeDom+iX) 
be strictly positive and such that sup ^^^xfM = b < oo; assume further that for 
any a such thatO < a < b, the sublevel set Sa{f) is finite. Let g : [0,b] R+ be 
an increasing function such that B :- foj^ < oo- If^fM ^ -g(/(x)) for all 
X t Saif) then ExTs„(/) < B for all x t SaCf), i.e. the chain implodes towards 

Saif). 

In some applications, it is quite difficult to guess immediately the form of 
the function / satisfying the uniform condition r/(x) < -e required for the first 
statement of the previous theorem 1.9 to apply. It is sometimes more conveni- 
ent to check merely that r/(x) < -g(/(x)) for some function g vanishing at in 
some controlled way. The proposition 1.10 — although does not improve the 
already optimal statement 1 of the theorem 1.9 — provides us with a convenient 
alternative condition to be checked. 



2 Proof of the main theorems 

We have already introduced the notion of Dom(r). A related notion is that 
of locally p-integrable functions, defined as £P{T) = {/ g mS^ : Y.y£X^xy\fiy) - 
f[x)\f < +00, Vx G X}, for some p > 0. Obviously £^iT) = Dom(r). In accord- 
ance to our notational convention on decorations, ^+ (r) will denote positive 
p-integrable functions. For / g (r) , we define the local f -drift of the embed- 
ded Markov chain as the random variable 

the local mean f -drift by 

m/(x) := mi+.lL = X) = ^ P^y(/(y) -/(X)) = E^Af, 

yeX 

and for p > 1 and / g £P{T) the p -moment of the local f -drift hy 

vf{x) E(|a{^JP||„ = X) = ^ Pxyl/(y) -/Wr = EJAf 1^ 

yeX 

We always write shortly Vf{x) := v^J\x). The action of the generator F on / 
reads 

F/(x) := Txyf{y) = Txmfix). 

yeX 
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Since (^f)f is a pure jump process, the process (Xf) f transformed by / £ Dom(r), 
i.e. Xt - /(^f), is also a pure jump process reading, for t<(, 

oo oo 
k=0 k=0 

If there is no explosion, the process {Xt) is a (=^f)-semimartingale admitting the 
decomposition Xt = Xo + Mt + At, where Mf is a martingale vanishing at and 
the predictable compensator reads [9] 

At=[ Tfi^s-)ds=[ Tf{^s)ds. 

J]0,t] J[0,f[ 

Notice that, although not explicitly marked, {Xt), (Mf), and {At) depend on /. 
Therefore, for any admissible / we have dXt - dMt + dAt - dMt + Tf{^ t-)dt. 



2.1 Proof of the theorems 1.3 and 1.4 on moments of passage 
times 

We start by the theorem 1.4 that — although stronger — is much simpler to 
prove. 

Lemma 2.1. Let (^ff),P) he a filtered probability space and {Yt) a {'^t)- 
adapted process taking values in [0,oo[. Let c > and denote T - inf{t > : 
Yt < c}; suppose that there exists e > such that E{dYt\'^t-) ^ -edt on the event 
{T > t}. Suppose that Yo = y almost surely, for some y e [c,oo[. Then Ey(r) < ^. 

Proof Since {T > t} e '^t-y the hypothesis of the lemma reads E(<iFfArl^^f-) ^ 
-e\{T>t\dt. Taking expectations and integrating over time, yields: < ECFjat) ^ 
y-e /o^PCr > 5)<i5 which implies eE(r) < y. □ 

Proof of the theorem 1.4. 
[2^1]: LetXf = f{£,t)\ then the condition 2 reads HdXt/yjp\'^t-) ^ -el{T:p>t}dt. 

fix) 

Hence, in accordance with the previous lemma 2.1, we get Ex(tf) < 
for every x^F. Now, let x e F. Then 

EAtf) = EATF\li^F)Vx{lieF) + Ex{rF\li^F)fx{li^F) 



sup 

xeF 



+2^ Pxy <00, 



the finiteness of the last expression being guaranteed by the conditions 
/ G Dom+(r) and the finiteness of the set F. Positive recurrence follows 
then from irreducibility of the chain. 
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[1^2]: Let F = {z} for some fixed z g X; positiive recurrence of the chain 
implies that Ejc(Tf ) < oo for all x e X. Fix some e>0 and define 

ffx) = \ ^^^""^^ if 

I otherwise. 

Then, m/(x) < Zy7^xPxy£^yiT^F)-£^x^'^F) = eEx{rF-cri]-eEjc[rF) = -eExicfi) = 
for all x^F. It follows that r/(x) =jx'nfix) < -c outside F. 

Writing Xf - /(^t), we check immediately that (Xf) satisfies the requirements 
of the lemma 2. 1 above. □ 
The proof of the theorem 1.3 is quite technical and will be split into several 
steps formulated as independent lemmata and propositions on semimartin- 
gales that may have an interest per se. As a matter of fact, we use these interme- 
diate results to prove various results of very different nature. 

Lemma 2.2. Let f e Dom+(r) tending to infinity, p>2, and a > 0. Use the ab- 
breviation A := Sa{f)- DenoteXt = /(^r) and assume further that fP e Dom+(r). 
If there exists oO such that 

IfP{x)<-cfP-^{x),yx^A, 

then the process defined by Zt = iX^^^t + ^ ^^^'^ ^ non-negative super- 
martingale. 

Proof Introducing the predictable decomposition 1 - li{T^<f) + ll{Tyi>f)> we get 
HdZt\3Pt-) = E(d(X2 + SL.t)P'^\3Pt-ni,^>t}- Now, (Xf) is a pure jump process, 
hence by applying Ito formula, reading for any g g and (Sf) a semimartin- 
gale, dgiSt) = g'(St_)<iSf -I- Ag(Sf), where (S^) denotes the continuous compon- 
ent of (Sf),weget 

dixf + —t)P'^ = ciXf +^t)P'^-'dt+{X^ + —t)P'^-iXf +—t)P'\ 
^ p/2 ^~ p/2 ^ p/2 p/2 

Writing the semimartingale decomposition for the process (Xf), we remark 
that the hypothesis of the lemma implies that 

EidXf\^t-)^TfP{^t-)dt<-cXf~^d ton the event {ta> t}. 

Applying conditional Minkowski inequality and the supermartingale hypothesis, 
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we get, on the set {ta > t}, 

pl2 . r , . . 



= [(Xf_+E(dXf|J^,_)2/P + 4-f]P/2 

pl2 

X2_ pl2 

' p/2 p/2 
Hence, on the event {ta ^ t}, we have the estimate 

EidZAJ^t-)<cixi+-^tr'-'dt+ixi+-^t--^dt)p''-ixi+-^tr\ 

p/2 p/2 p/2 p/2 

Simple expansion of the remaining differential forms (containing now only ^t-- 
measurable random variables) yields E(dZf |=^f_) < 0. □ 

Corollary 2.3. Letf £ Dom+ (F) tending to infinity, p>2, and a > 0. Use the ab- 
breviation A:- Sa{f)- Denote Xt = f{£,t) and assume further that fP g Dom+(r). 
If there exists c> such that 

IfP{x)<-cfP-^{x),yx^A, 

then there exists c' > such that 

E^CtJ < c'fixf for all q<p/2 and all xeX. 

Proof. Without loss of generality, we can assume that x e A'^ since otherwise 
the corollary holds trivially. Denoting by Yt - X^^^^ + t A t^i, we observe that 

Zt - is a non-negative supermartingale by virtue of the lemma 2.2. Since 
the function R+ 3 w w^'^'f £ IR+ is increasing and concave for q < p/2, it 
follows that is also a supermartingale. Hence, 

j^EAitATA)''] < EAYf'') < EAY^^) = fixf^. 

We conclude by the dominated convergence theorem on identifying c' = ^ . □ 

Proposition 2.4. Let f e Dom+(r) tending to infinity, < p < 2, and a > 0. 

Use the abbreviation A := SAf)- Denote Xt = fi^t) (md assume further that 
fP £ Dom+(r). If there exists c> such that 

TfP (x) < - cfP~^ (x) , Vx ^ A, 

then the process, defined by Zt = X^^^^ + ^ {ta a t)'', satisfies 

EAZt) < c"fix)P, for all q e]0, p/2]. 



13 



Proof. Since d(Xf + ^ti) = dxf + ct'^-^dt, we have 
Now, ^^j^j^- Choosing ve]^,^ [, we write 

EidZtl^t-) < cd?]i{,^>f)(-Xf_"' + ?'?-l)]i{x,_e]fl,f^]} 

+ cdt'W.{j^>t]i-X^_ ^ + t'^ ^)li{Xt_e]f",+oo]}- 

For Xf_ < , the first term of the right hand side of the previous inequality is 

v—2. 

non-positive; as for the second, the condition Xf_ > implies that -X^_ + 
< f'/-! Combining the latter with Markov inequality guarantees that, on 

the set {Xt- > t"}, we have ^xidZt) < cdtiiij^^t]^^^^'^- Integrating this dif- 
ferential inequality yields ExiZt) < cf^ix) J^ivjuprr^', the condition v > qlp 
insures the finiteness of the last integral proving thus the lemma with c" - 

fOO dt |-| 

Corollary 2.5. Under the same conditions as in proposition 2.4, there exists c'" > 
such that ExiT^) < c'" f{x)P ,yq £]0,p/2]. 

Proof. Since Xf is non-negative, ^Zj > {t A r By the previous proposition, 
E^[(r A T^)"?] < ^Ex{Zt) < c"^f{x)P. We conclude by the dominated conver- 

c" a 

gence theorem on identifying c'" = □ 

Remark . All the propositions, lemmata, and corollaries shown so far allow to 
prove statement 1 of the theorem 1.3. The subsequent propositions are needed 
for statement 2 of this theorem. Notice also that the following proposition 2.6 
is very important and tricky. It provides us with a generalisation of the theorem 
3.1 of Lamperti [11] and serves twice in this paper: one first time to establish 
conditions for some moments of passage time to be infinite (statement 2 of 
theorem 1.3) and once more in a very different context, namely for finding con- 
ditions for the chain not to implode (statement 2 of theorem 1.9). 

Proposition 2.6. Lef (H, ("^f ) f , P) be a filtered probability space and {Yt) be a 
C^f ) -adapted process taking values in an unbounded subset ofU+ . Let a > and 
Ta = inf{t >0:Yt< a}. Suppose that there exist constants Ci > and C2 > such 
that 

1. E{dYt\'^t-)^-cidt on the event {Ta> t},and 

2. thereexists r > 1 such thatE{dY[Y^t-) ^ czY^S^dt on the event {Ta > t}. 
Then, for all a e]0, 1[, there exist e > andd > such that 

yt>0:P{Ta>t + eYt;,Tj^t) > 1 - a, on the event {Ta > t;Yt> ail + 5)}. 
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Remark . The meaning of the previous proposition 2.6 is the following. If the 
process (Yf) has average increments bounded from below by a constant -ci, 
it is intuitively appealing to suppose that the average time of reaching is of 
the same order of magnitude as Yq. However this intuition proves false if the 
increments are wildly unbounded since then can be reached in one step. The 
condition 2, by imposing some control on r-moments of the increments with 
r > 1, prevents this from occurring. It is in fact established that if Ta > t, the 
remaining time Ta - t to reach Aa :- [0, a] exceeds eYt with probability I - a; 
more precisely, for every a we can chose e such that P{Ta - t> eYtWt^ > 1 - a. 

Proof of proposition 2.6. Let a = {Ta - t)'\[{T„>a}', then for all 5 > we have {a < 
s} = {Ta> t} n{Ta < t + s}e ^t+s-- To prove the proposition, it is enough to 
establish P(cr > eYtl'^t) > 1 - a on the set {a > 0;Yt > a(l + 6)}. On this latter 
set: P(cr > eYtl^t) ^{Yt+(eYt)Aa > a\'^t), because once the process Yt+[eYt)^a 
enters in Aa, it remains there for ever, due to the stopping by cr. On defining 
U := Y[eYt]Aa+t one has 

EiUl'^t) - E(?71i{[/<fl)|';^f) + E([71i[/>fl) 



PiU>am)) 



therefore 

To minorise the numerator, we observe that 

EiUm) = HYt+eYr - Ytm) + Yt = j^ HdY^m) + n > -CieYt + Yf 

To majorise the denominator EiLf]^) = ^(Yf'^^^y^j^g.l'J^f), we must be able to 
majorise EiYf_^_^^^\'i§t) for arbitrary s > 0. Let t > be arbitrary and S be a 'r§t- 
optional random variable, S > 0. For 03 = Cz/r and any 5 g] 0, S] , define 

Fs{s) = EKYt+sAa + C3S-C3SAay'\^t]. 

We shall show that Fsis) < Fsis-) for all 5 £]0, S]. It is enough to show this in- 
equality on {a > s} since otherwise Fsis) = Fsis-) and there is nothing to prove. 
To show that Fs is decreasing in ] 0, S] , it is enough to show that EidEs\'i§t+s-) ^ 
for all 5 g]0, S], where Eg = {Yt+sAa + C3S - C3S A aY. Now, on {a > s}, by use of 
Ito's formula, we get 

dEs ^ -rc3{Yt+s- + C3S - C3sY~'^ds+{Yt+s + C3S - C3S)'' - {Yt+s- + C3S-C3S)''. 

Moreover, using Minkowski inequality, we get 

E[iYt+s + C3S-C3sVm+s-] < [EiY;^,m+s-)^^'' + C3S-C3sY, 
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and by use of the hypothesis 

Therefore, Ud'EsWt+s-) ^ for all 5 e]0, S]. Subsequently for all S > 0; 

Y^^s = PsiS) < lim Fsis) = {Yt + C3SV. 

Since 5 is an arbitrary ^^^-optional random variable, on choosing S = cYf, we 
get finally 

mYl^^Y^'^t))''' <Yt + C3eYt. 

Substituting yields, that for any a e]0, 1[, parameters e: > and 5 > can be 
chosen so that the following inequality holds: 



PiU>a\'^t)^ 



(l-cie)-^)+ 
I-C3C 



> (1-CiC- 



1 ^ 

)l il + c^e) r-i > i-a. 



1 + 5 



□ 



Lemma 2.7. Let iD.,'^,i'^t)>P') be a filtered probability space, (Yt) and [Zt) two 
R+ -valued, {'^t)-(^(^pted processes on it. For a> 0, we denote Sa - inf{f > : 
Yf < a} and Ta = inf{? > : Zf < a}. Suppose that there exist positive constants 
a, b, p, Ki such that 

1. Yt< bZt almost surely, for all t, and 

2. HZl^)^K,. 

Then, there exists > such that EtF/' ) < ^^2. 



Proof. For arbitrary 5 > 0, the condition Zs < a implies Xs < bZg < ab almost 
surely. Hence, {5^^ > t} Q{Ta>: t}. Then, 



E(F.^„ ) < E 

tASab 



< E(F/']i{s^,>f}) + {ab)P < bPKi + {ab)P := K2. 



□ 



Proposition 2.8. Let (Q,^^, (^ff),P) be a filtered probability space, (Ff) and{Zt) 
two R+ - valued, i'^t) -adapted processes on it For a>0, we denote Sa - inf{ t>0: 
Yt < a} and Ta = inf{f > : Zf < a}. Suppose that 

1. there exist positive constants a, ci, C2, r such that 
- EidZ^l'^t-) ^ -cidt on theevent{Ta > t}. 
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- E{dZ^\(St-) < CzZlZ^dt on the event {Ta > t}, 

- Zq = z> a. 

2. Yo = y and there exists a constant b>0 such that 

- ab < y < bz and 

- Yt<bZt almost surely for all t. 

If for some p>0, the process (i^f^5 ^) is a submartingale, then EiT^) - oo for all 
q>p. 

Proof. We can without loss of generality examine solely the case PiSab < oo) = 
1, since otherwise E(r^) = co holds trivially for all q >0. Assume further that for 
some q > p,it happens E(rJ) < oo. Hypothesis 1 allows applying proposition 
2.6; for a = 1/2, we can thus determine positive constants e and 5 such that 
PiTa> t + eZt/.rJ'^t) > 1/2 on the event {ZfAr„ > a(l + 5)}. Hence 

EiT^) > EiTUiZ,,T„>aii+S)}) 

> —EiZ^^^) a'' a + 5)''. 

2 ^^^^ 2 

Now, finiteness of the q moment of Ta implies the existence of a constant iCi > 
such that EiZ'l^j. ) <Ki. From the previous lemma 2.7 follows that there exists 

some K2> Q such that E(y,'J' „ ) < K2. Since the time Sab is assumed almost 
surely finite, limf^oo ECK'I . ) = E(F<f ) < (afo)^. On the other hand, {Yf^ ^ ) is 
a submartingale, so is thus a fortiori {Y^^^ ). Hence, EiY''^^ ) > E{Y!^) = yi, 
leading to a contradiction if we chose y > ab. □ 

Corollary 2.9. Let{D.,^ ,{'^t)yP) be a filtered probability space, {Xt) aR+-valued, 
{'^t) -(adapted processes on it. For a>0, we denote Ta = inf{t >0:Xt<a}. Sup- 
pose that there exist positive constants a, ci,C2,p,r such that 

- Xo- x> a, 

- E{dXt\'^t-) ^ -c\dt on the event {Ta > t}, 

- EidX'^l^t-) ^ CzX'^Z^dt on the event {Ta > t}, 

- iX^^j, ) is a submartingale. 

ThenE{Ta) = 00 for all q > p. 

After all this preparatory work, the proof of the theorem 1.3 is now immedi- 
ate. 

Proof of the theorem 1.3. Write Xt = /(<f f) and use the abbreviation A := Saif). 
Notice moreover that = Ta- 
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1. Since / ^ oo the set A is finite. The integrability of the passage time fol- 
lows from corollaries 2.3 and 2.5. 

2. On identifying Zf and Ff in proposition 2.8 with f) and /(^ f) respect- 
ively, we see that the conditions of the theorem imply the hypotheses of 
the proposition. The non-existence of moments immediately follows. 



2.2 Proof of theorems on explosion and implosion 

As stated in the introduction, the result concerning integrability of explo- 
sion time is reminiscent to Foster's criterion for positive recurrence! The reason 
lies in the lemma 2.1 and the fact that theorem 1.5, establishing explosion, is 
equivalent to the proposition 2.10 below. 

Since we wish to treat explosion, we work with a Markov chain evolving on 
the augmented state space X = X u {5} and with augmented functions / as ex- 
plained in the introduction. Note that if / > then f\x = f>0 while fid) - 0. 
We extend also naturally Xt = /(^ j) (and stricto sensu also the generator T). We 
use the "hat" notation ^ to denote quantities referring to the extended chain. 

Proposition 2.10. Let f : X [0,oo[ belong to Dom+(f) and verify fix) > 
for all X eX (it vanishes only at d). We denote f the restriction off on X. The 
following are equivalent: 

1. There exists e>0 such that Tfix) < -e for allxeX. 

2. Exitg) <oo for all xeX. 

Proof Let Yt = /(If), for t > 0. Then iYt) is a [0,oo [-valued, (#f) -adapted pro- 
cess. Note also that f a = To := inf{f > : Ff = 0} 

[1 => 2:] The condition r/(x) < -e for all x g X is equivalent to the condition 
EidYtATol'^t-) ^ -e'W.To>tdt. The conclusion follows from direct applica- 
tion of the lemma 2.1. 

[2 1:] Define fix) = eEAfd)- Obviously fid) = while < fix) < oo for all 
X G X. Conditioning on the first move of the embedded Markov chain | 
we get: 



□ 



mfix) = E(/(^i)-/(x)|^o 



x) = E(/(^/J-/(^o)l^o = x) 

- cEAfd) = eiEAfd) - EAcTi)) - eEAfd) 



= e Pxy^yifd) 



yeX\!ji:} 



= -eEA(7i)^-—. 

Tx 



Hence r/(x) < -e for all x g X. 



□ 
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Proof of the theorem 1.5. Evident by proposition 2.10, since ( - fg. 



□ 



Proof of the proposition 1.6. Let G(z) = Jo j^- Then G is differentiable, with 
G'{z) - > hence an increasing function of z e [0, b]. Since g is increas- 
ing, G' is decreasing and hence G is concave satisfying lim^^o G(z) = and 
lim^^oo G(z) < oo. AdditionaUy, boundedness of G impfythat Gofe£^{T). Due 
to differentiability and concavity of G, we have: 



we conclude by theorem 1.5 because G o / is strictly positive and bounded. □ 

Proof of the theorem 1.7. The conditions of the theorem imply transience of 
the chain. In fact, let Yt = fi^tATA^- The condition r/(x) < -e on A'^ implies 
that (Ff) is a non-negative supermartingale, converging almost surely towards 
YoQ. For every x e , Fatou's lemma implies Ex(Foo) < limf^ooEjc(i^f) ^ fi^)- 
Suppose now that the chain is not transient, hence < co) = 1. In that case 

limj^co - almost surely. We get then by monotone convergence theorem 
inf ye^/(y) < Ejc(/(^ta)) - /(■^)' in contradiction with the hypothesis that there 
exists A^ such that f{x) < infy£^/(y). Hence, PjcCt^ = oo) > 0. 

Let now T := t^a^; on defining Zf = /(^ fAr). we obtain then that E(<iZf |^f_) < 
-eli{7'>f)d?. We conclude by proposition 2.10 and the fact that the event {x a = 
oo} is not negligible. □ 

Proof of the theorem 1.8. Let G(z) = Jo -^dy; this function is differentiable 

with G'{z) = > 0, hence increasing. Since g is increasing, G' is decreasing, 
hence G is concave. Non integrability of the infinite tail means that G is un- 
boundedly increasing towards oo as z ^ oo, hence G o / ^ oo. Concavity and 
differentiability of G imply that G(/(x) + A) - G(/(x)) < AG'(/(x)); integrability 
of / guarantees then < E(G(/(|„) + ^{^,)\L = x) < G(/(x)) + < oo so 

that F := G o / G (F) as well. Now 



FGo/(x) 



TxE G(/(L) + a{^i)-G(/(|J)||„ = x 



1 F/(x) 
Tx — mfix) - — < -c; 



FGo/(x) 



Tx^ G(/(L) + - = X 




1 



mfix) < c. 
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Let Xt = f ) be the process obtained form the Markov chain after transforma- 
tion by F. Using the semimartingale decomposition of Xt - Xq+Mj + TF{,^s-)ds, 
it becomes obvious then that ExXt < F(x) + ct, showing that for every finite t, 
PxiXt = oo) = 0. But since F ^ oo the process itself cannot explode. 

□ 

Proposition 2.11. Suppose the chain is recurrent and there exists a finite set 
AeSC and a constant C > such that, for all x g X, the uniform hound Ej^T/i < C 
holds. Then the chain implodes towards any state z g X. 

Proof First remark that obviously ctq < r a, where ctq is the holding time at 
the initial state, i.e. - EjcCo'o) ^ E^t^ < C. Hence y :- inf^exTx > 0. Let a 
be an arbitrary point in A and z an arbitrary state in X. Irreducibility means 
that there exists a path of finite length, say k, satisfying a = xq, . . . , xa; = z and 
Fxo,xi • • • Pxk-i,xk = > 0. Then, for K' > ^ sup^^^ ka, we estimate 

ka-l 

V>a{T,<K')>Va{ Cfi<K'\l^ = Xi,...,l^^Xk = zWa{ll^Xi,...,lk = Xk = Z). 

Now, Markov's inequality yields VaiTz < K') > (1 - ^)5a < ^inffl^a := 5' > 0. 

Using exactly the same arguments, we show that PaCt^c < K") >6">0 for some 
parameters K" < oo and d" > 0. 

Denote K = max{K',K") < oo, 5 = mm{6',d") > 0, and r = sup^g^EgCTz). 
The hypothesis of the proposition implies 

ExTz = EATz\Tz<TAWairz<TA)+^x(.rz\Tz>TA)Pairz>TA) 

< C + EArz\rz>rAWairz>rA)- 

NowE;,(t^|t2 > ta) < pJ;J>Tj +^xmrz-rA\^TA)\rz < ta). We get finally E^t^ < 
2C+r. 

On the other hand, 

Efl(T^) = EAt z\r z < K)P air z <K) + EArz\Tz>K)P air z>K) 
= K + EaiEx^irz)). 

Now, on the set {t^ > K}, X^ can be any a' g A or any x' g A*^ \ {z}. Hence, 
Eairz) < K + 5max[Zx'eA':\{z]^x'rzP'aiXK^x'),Y.a'eA^a'rzP'aiXK^a')). Using 
the previously obtained majorisations, we get Earz < K + 5(2C + r) and tak- 
ing the maXfl of the l.h.s. we obtain finally r (1 - 5) < K + 2C5 proving thus that 
sup^ Exrz <2C+ that guarantees implosion towards any z g X. □ 

Proof of the theorem 1.9. 
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1. We first show implosion. Since /is bounded, the condition r/(x) =7x'^/W ^ 
-e guarantees that 7 - mix jx > 0. 
[=>:] The condition r/(x) < -e for x ^ Saif) guarantees — by virtue of 

fix) fiz) 

the proposition 2.10 — that EjcTs^(/) < < sup2g.Sfl(/) Abbre- 
viate B Sfl(/) and remark that B is finite by hypothesis. Now, due 
to recurrence and irreducibility, if there exists a constant C such that 
X ^ B => ExTb < C, then, for every z eX, there exists a constant C' 
such that x^ ExT{z] < C , by virtue of the previous proposition 
2.11. 



that E^Tyi < C. Consequenhy j- < E^Xyi < C, leading necessarily to 



[<=:] Suppose now that for a finite Ae3C, there exists a constant C such 
that E^Tyi < C. Consequenlty 
the lower bound 7 > 0. Define 

/(X) 



if xGaA 
E^ta if x^aA. 

Then it is immediate to show that A = Si (/) and that for x ^ A, we 
haver/(x) < -1. 

2. To show non-implosion, use lemma 2. 1 to guarantee that if at some time t 
the process is at some point xo sufficiently large, then the time needed 
for the process Xt = fi^t) to reach Saif) exceeds e"/(xo) with some sub- 
stantially large probability. More precisely, there exists a £]0, 1 [ such that 
PxoCfSj/) - ^ > e/(xo)) > 1 - a. Therefore Exoirs^i/)) > (1 - a)c/(xo) and 
since / ^ 00 then this expectation cannot be bounded uniformly in xq. 

□ 

Proof of the proposition 1.10. Let G(z) = f^ Since G'iz) = > the func- 
tion G is increasing with G(0) = and Gib) = B. Since g is increasing G' = ^ 
is decreasing, hence the function G is concave. Then concavity leads to the 
majorisation 

mAx) 

mGo/(x) < G'{f{x))mf{x) = —7-—. 

gifix)) 

The condition imposed on the statement of the proposition implies that FG o 
/(x) < -1. We conclude from lemma 2.1. □ 



3 Application to some critical models 

This section intends to treat some problems that even with without the ex- 
plosion phenomenon have critical behaviour illustrating thus how our meth- 
ods can be applied and showing their power. 
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We need first some technical conditions. Let / g ^^+°o for some do > 0. For 
every g : IR+ ^ [R+ a function, we get 

mg.fix) = E{gifi^n+i))-gifiL))\L^ X) = g'{fix))mfix) + ^g''ifix))Vfix)+Rgix), 

where Rg{x) is the conditional expectation of the remainder occurring in the 
Taylor expansion ^. 

Definition 3.1. Let F = {Fn)n£N be an exhaustive nested sequence of sets F„ t 
X, / G £l+^iT) and g e C^{R+;R+). We say that the chain (or its jumps) satisfies 
the remainder condition (or shortly condition R) for F, f, and g, if 

lim supi?g(x)/[g'(/(x))m/(x) + ig"(/(x))i;/(x)] =0. 

The quantity Dg{f,x) := g'(/(x))m/(x) + jg"ifix))vfix) in the expression 
above is the effective average drift at the scale defined by the function g. If the 
function / is non-trivial, there exists a natural exhaustive nested sequence de- 
termined by the sub-level sets of /. When we omit to specify the nested se- 
quence, we shall always consider the natural one. 

Introduce the notation ln(o) 5=5 and recursively, for all integers A: > 1, In(yt) 5 = 
ln(ln(yt-i) s) and denote by Lids) - nf=o^^(') ^' k>0, and Ljds) :- 1 for A; < 0. 
Equivalently, we define exp(^) as the inverse function of In(yt). In most occa- 
sions we shall use (Lyapunov) functions g{s) := In^^j 5 with some integer I > 
and some real r/ ^ 0, defined for 5 sufficiently large, s > so := exp(;j(2) say. It is 
cumbersome but straightforward to show then that for / g £^+^o (p ^ with some 
do > 0, the condition R is satisfied. It will be shown in this section that condi- 
tion R and Lyapunov functions of the aforementioned form play a crucial role 
in the study of models where the effective average drift Dgif, x) tends to in 
some controlled way with n when x g F^, where (F„) is an exhaustive nested 
sequence; models of this type lie in the deeply critical regime between recur- 
rence and transience. 

3.1 Critical models on denumerably infinite and unbounded 
subsets of U+ 

Consider a discrete time irreducible Markov chain (|„) on a denumerably 
infinite and unbounded subset X of IR+. Since now X inherits the composi- 
tion properties stemming from the field structure of U, we can define directly 
m(x) := mid(x) and vix) Vi^ix), where id is the identity function on X. The 

2. The most convenient form of the remainder is the Roche-Schlomlich one. 
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model is termed critical when the drift m tends to 0, in some precise manner, 
when X ^ oo. 

In [10] Markov chains on X = {0, 1,2, . . .} were considered; it has been estab- 
lished that the chain is recurrent if m(x) < v{x)/2x while is transient if m(x) > 
0t'(x)/2x for some > 1. In particular, if m(x) = and vix) = the model 
is in the critical regime. 

The case with arbitrary degree of criticality 

^ ai ( I \ , ^ xPi ( X ] 

mix) - > + o and vix) = > + o , 

i^oLiix) \Lic{x)l i^oLdx) UfcWi 

with ai,l5i constants, has been settled in [13] by using Lyapunov functions. Un- 
der the additional conditions 

limsupl,, = oo and liminf vix) > 

and some technical moment conditions — guaranteeing the condition R for 
this model — that can straightforwardly be shown to hold if id g {^'^^°{T), for 
some 6o > 2, it has been shown in [13] (theorem 4) that 

- if 2ao < jSo the chain is recurrent while if 2ao > Po the chain is transient; 

- if 2ao = )6o and 2a, - Pi- Po = for all / : < / < A; and there exists / : < 
/ < A; such that Pi>0 then 

- if2ayt-/3fc-j6o<0 the chain is recurrent, 

- if2ayt-/3fc-j6o>0 the chain is transient. 

We assume that the moment conditions id g £^+^o ^y) — guaranteeing the 
condition R for this model — are satisfied through out this section. 
Let i^n) be a IVIarkov chain on X = {0, 1, . . .} satisfying for some A; > 



k-l 



m(x) = > + + 



Lkix) 



and vix) = Po + oil), 



with 2ak > Po- The aforementioned result guarantees the transience of the 
chain; we term such a chain k-critically transient. When 2ak < Po the previous 
result guarantees the recurrence of the chain; we term such a chain k-critically 
recurrent. 

In spite of its seemingly idiosyncratic character, this model proves univer- 
sal as Lyapunov functions used in the study of many general models in critical 
regimes map those models to some A;-critical models on denumerably infinite 
unbounded subsets of U+. 
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3.1.1 Moments of passage times 

Proposition 3.2. Let (^f) be a continuous-time Markov chain on X and A be 
the finite setA:= [0, xq] n X for some sufficiently large xq. Suppose that for some 
integer k > 0, its embedded chain is k-critically recurrent, i.e. 

iSo ak ( I \ 
fr'oZLiix) Lfc(x) UfcWj 

tf/t/i 2ayt < )6o- Denote C - ajcl (5o (hence C < 1/2) and assume there exists a 



L (x) 

constant k > such that^ jx = k r J for large x. Define po := po{C,K) = 
(1-2C)/JC. 

1. Assume that v^p\x) = with p = max(2, 1 - 2C) + do. Ifq<po then 

E;,tJ < OO. 

2. Assume that v^p^ (x) = with p = max(2, po) + Sq. Ifq > Pq then E^t^ = 

OO. 

Remark . We remark that when k \ (for fixed k and C) then Pq \ oo implying 
that more and more moments exist. 

Proof of the proposition 3.2. For the function fix) = In^^^ x we determine 

1 in?^ax) 



m/(x) = ^)6o77(2C + 77- 1 + o(l))--f^ 



1. For a > 0, we remark that 



[0<pr]<l-2C and 77> |] ^r/P(x) < -cfP~^{x), 

for some constant c> 0. Hence p<2(l-2 C)/k and statement 1 of the 
theorem 1.3 implies for any q e]0, (1 - 2C)/k[, the q-th moment of the 
passage time exists. Optimising over the accessible values of q we get 
that Ex(t^) < OO for all q < po. 

2. We distinguish two cases: 

[1 - 2C < k:] We verify that, choosing rj e]l - 2C,k] and p > the 
three conditions conditions of statement 2 of the theorem 1.3 (with 
/ = g), namely Tf > -Ci, Tf^ < C2f^~^, for some r > 1, and F/p > 0, 
outside some finite set A. 



1 J I Injv, [x] 

3. i.e. there exists a constant C3 > such that 7- < — -27^^- — < C3 for x > xq. 

4. The constant c can be chosen c > |/3o77(l - 2C)C3. 
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[k < 1 -2C:] In this situation, choosing the parameters t] e]0,K] and 
p > implies simuhaneous verification of the three conditions 
of statement 2 of the theorem 1.3. 

In both situations, we conclude that for all q > the corresponding 
moment does not exist. Optimising over the accessible values of q, we get 
that Ex(t^) = oo for all q > po. 

□ 



3.1.2 Explosion and implosion 

Proposition 3.3. Leti^t) be a continuous time Markov chain. Suppose that for 
some integer k>0, its embedded chain is k-critically transient. 

1. If there exist a constant di > 0, an integer I > k, andarealx > (arbitrarily 
small) such that 

jx ^ diL]c{x)Li{x)(lnii) xf,x>Xo, 

then Py (C < oo) = 1 for all y £ X. 

2. If there exist a constant d2>0 and an integer I > k such that 

jx < d2Lk{x)Li{x),x> xo, 
then the continuous-time chain is conservative. 

Proof. 1. For a A;-critically transient chain, chose a function / behaving at 
large x as /(x) = prTT- Denote C = ajc/Po (hence C > 1/2 for the chain to 

llljjj (x) 

be transient). We estimate then 



m/(x) = -2)6o?7(2C- 1) — + o( —). 

Lkix)Liix) Inj'^j X Lkix)Li (x) In^'^j x 

We conclude by theorem 1.5. 

2. Choosing as Lyapunov function the identity function /(x) = x and estim- 
ate 

"^ina.i.o/W = 2/3o(2C-l) l''^^^^ = 2/3o(2C- 1)-— . 
' ' Lkix)Li+iix) Lfc(x)L/(x) 

We conclude by theorem 1.8 by choosing g{s) - Li{s). 

□ 
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Proposition 3.4. Let (^f) be a continuous time Markov chain. Suppose that 
for some integer k>0, its embedded chain is k-critically recurrent. Denote C = 
ajc/Po (hence C < 1/2 for the chain to be recurrent). Let A be the finite setA:= 
[0, xq] n X for some sufficiently large xq. 

1 . If there exist a constant di>, an integer l> k, and an arbitrarily small real 
K > such that 

then there exists a constants such thatEyiA < B, uniformly in y e , i.e. 
the chain implodes. 

2. If there exist a constant dz > and an integer I > k such that 

Yx < d2Lk{x)Li{x),x > Xq, 
then the continuous time chain does not implode. 

Proof. 1. Use the function / defined for sufficiently large x by the formula 
/(x) = 1 - pj— , for some / > k and > 0. We estimate then 

mdx) = 2l5oVi2C-l) ^- — + o( ^- —). 

Lfc(x)L/(x) In^'^^ X Lic{x)Liix) \n'^^ x 

We conclude by statement 1 of theorem 1.9. 

2. Using the function / defined for sufficiently large x by the formula /(x) = 
In^^^^j X, for some / > k. We estimate then 

In^ X In^ X 

mdx) = 2^o?7(2C- 1) — + o( — ). 

Lfc(x)L/+i(x) Lfc(x)L/+i(x) 

If Yx ^ dzLicMLi (x) for large x, then, using the above estimate for the case 
rj = I and the case t] = r for some small r > 1, we observe that the condi- 
tions Tf > -e and F/'' < f'^ are simultaneously verified. We conclude 
by the statement 2 of the theorem 1.9. 

□ 



3.2 Simple random walk on Z for d = 2 and d>3 

Here the state space X = and the embedded chain is a simple random 
walk on X. Since in dimension 2 the simple random walk is null recurrent while 
in dimension d > 3 is transient, a different treatment is imposed. 
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3.2.1 Dimension d > 3 

For the Lyapunov function / defined by Z*^ 3 x /(x) := ||x||, we can show 
that there exist constants ao > and jSo > such that limnxn^oo l|x|| my(x) = ao 
and lim||;c|Hoo Vf{x) = /3o such that C = ao/ f^o > 1/2. Therefore the one dimen- 
sional process Xt = t) has 0-critically transient Lamperti behaviour. 

We get therefore that {£, t) ten.+ is a (quite unsurprisingly) transient process 
and that if there exist a constant a>0 and 

- a constant di > 0, an integer / > 0, and a real k > (arbitrarily small) such 
that 

r;c>rfillx||IKI|x||)(ln(/) ||x||)M|x||>a, 

then Py(C < oo) = 1 for all y £ X; 

- a constant da > and an integer / > such that 

7x<d2llx||L/(||x||),||x|| >a, 
then the continuous time chain is conservative. 

3.2.2 Dimension 2 

Using again the Lyapunov function /(x) = || x|| , we show that the one dimen- 
sional process Xt = /(<ff) is of the 1 -critically recurrent Lamperti type. Hence, 
again using the results obtained in §3.1, we get that if there exist a constant 
a > and 

- a constant rfi > 0, an integer Z > 1, and an arbitrarily small real k > such 
that 

> diLi(||x||)LK||x||)(ln(Z) ||x||)^ llxll > a, 

then there exists a constant C such that EyX^ < C, uniformly in y for y : 
llyll > a, i.e. the chain implodes; 

- a constant ^2 > and an integer / > 1 such that 

7;,<d2li(||x||)LKI|x||),||x||>a, 
then the continuous time chain does not implode. 

3.3 Random walk on J.\ with reflecting boundaries 

3.3.1 Tlie model in discrete time 

Here X = Z\. We denote by X = {x g : Xi > 0, X2 > 0} the interior of the 
wedge and by diX = {x g Z^ : X2 = 0} (and similarly for 52%) its boundaries. 



27 



Since X is a subset of a vector space, we can define directly the increment vec- 
tor D :- - ^„ and the average conditional drift mix) :- mid(x) - E(D||„ = 

x) G IR"^. We assume that for all x g X, m(x) = so that we are in a critical regime. 
For X G 5t,X; with b-l,2, the drift rn^ix) does not vanish but is a constant vector 

m that forms angles (p with respect to the normal to 3t,X. For x g X, the con- 
ditional covariance matrix C(x) := (C(x),y), with C{x)ij{= E[DiDj\^n = x], is the 
constant 2x2 matrix C, reading 



C:=Cov(D,D) 



'sj A 



^2 



There exists an isomorphism O on such that Cov(OD,OD) = OCO^ = /; it is 
elementary to show that 



{S2 X ^ 

d 52 d 



where d - vdetC, is a solution to the aforementioned isomorphism equation. 
This isomorphism maps the quadrant IR^ into a squeezed wedge 0([R^) having 
an angle y/ at its summit reading y/ = arctan(-d^/A). Obviously y/ = nil if A = 
0, while y/ G]0,7r/2[ if A < and y/ e]ji/2,n[ if A > 0. We denote Y = <1)(X) the 
squeezed image of the lattice. The isomorphism O transforms the average drifts 
at the boundaries into n}' = (Drri^ formingnew angles, y/^,, with the normal to the 
boundaries of 0(IR+). 

The discrete time model has been exhaustively treated in [1] and its exten- 
sion to the case of excitable boundaries carrying internal states in [12]. Here we 
recall the main results of [1] under some simplifying assumptions that allow us 
to present them here without redefining completely the model or considering 
all the technicalities. The assumptions we need are that the jumps 

- are bounded from below, i.e. there exists a constant K>0 such that Di > 
-K and D2 > -K, 

- satisfy a sufficient integrability condition, for instance EdlDH^^^") < 00 for 
some 60 > 0, 

- are such that their covariance matrix is non degenerate. 

Under these assumptions we can state the following simplified version of the 
results in [1]. 

Denote by x = iy/i + y/2)/y^andA = {xgX: ||x|| < a}. 

1. If ;^; > the chain is recurrent. 

2. If < the chain is transient. 

3. If < X < 2 + 5o, then for every p < x/2 and every x^A, E^t^ < 00. 

4. If < X < 2 + 5o, then for every p > x/^. and every x^A, E^t^ = 00. 
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Let / : [R2 ^ [R+ be a function. Define /(y) = Although the 

Hessian operator does not in general transform as a tensor, the linearity of <1> 

o 

allows however to write Hessy^(x) = Hessy^(<l)x)<l>. For every x g X we estab- 
lish then ^ the identity: 

E((D, Hess/o(i)WD>|^„ = x) = Lap^„,i,(x). 

We denote by hp^p^ix) = ||x||^cos(/3arctan(^) - /3i). Then this function is 
harmonic, i.e. Lap^^^^ = 0. We are interested in harmonic functions that are 

positive on O(IR^); positivity and geometry impose then conditions on (5 and Pi. 
In fact, sign(j6)/3i is the angle of V/z^,^^ (x) at x g diX, with the normal to diX. 
Similarly, if P2 - PV^ - Pi> then sign(j6)/32 is the angle of the gradient with the 
normal to dzX. Now, it becomes evident that /3/, / = 1,2, must lie in the interval 
]-7T/2,n/2[ and subsequently /3 = Notice also that the datum of two ad- 

missible angles Pi and P2 uniquely determines the harmonic function whose 
gradient at the boundaries forms angles as above. Hence, (V^^g^^jCy), = 
Wyf Psinixf/i, - Pi,), for y e d\,Y andb = 1,2. 

Let now g : [R+ ^ IR+ be a function and h - hp^p^ an harmonic func- 
tion that remains positive in 0([R^). On denoting y = Ox, abbreviating H := 
g{h{(^ln+\)) - gih{,(S>^ri)), and using the fact that h is harmonic, we get 

E(E||„ = x) = g'ihiyW{{yhiy),^D)\^n^x) 

+ ^-Y^E({V/z(y),cDD>2|^„ = X) 

+ ^^--Y^E«cDD, Hess^(y)cDD>|^„ = x) + i?3 

= g'ihiy)){Vh{y),n{y)) + ^-^^j^\\yhiy)f + R3{y), 

where R3 is the remainder of the Taylor expansion. The value of the condi- 
tional increment depends on the position of x. If x e 5t,X the dominant term 
of the right hand side is g'(/i(y))< V/z(y), n^>, while in the interior of the space, 
that term strictly vanishes because there niy) = 0; hence the dominant term 
becomes the term \\Vh{y) f. 

3.3.2 The model in continuous-time 

Proposition 3.5. Let < % = iV^i + ^^2)/^ (hence the chain is recurrent) and 
A:= Aa- {xeX: \\x\\ < a} for some a>0, andjx = 0'(||x||^"'^); denote po = xIk. 
Suppose further that id e £P (F) for some p>2. 

5. Since we have used the symbol A to denote the jumps of the process, we introduce the 
symbol Lap to denote the Laplacian. 
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1. Ifq < po, then ExCi"^) < oo. 

2. Ifq > Po, then Ex(t^) = oo. 

Proof. Consider the Lyapunov function fix) = hp^p^ {x)^. 

1. If < p77 < 1 then mpix) < 0. The condition TfP < -cfP~^ reads then 

Yx > C^#2 — = C "^"'pg? = C'Wxf-^P"^ from which follows that 2/377 > 

K. This inequality, combined with 0< prjKl, yields that for all <7 < ^ < p 
Ex (t^) < oo. Hence, on optimising on the accessible values of q we obtain 
the value of po. 

2. We proceed similarly; we need however to use the full-fledged version of 
the statement 2 of theorem 1.3, with both the function / and g - 
Then fix) < Cg(x) and 

[t]P < K and rjp>l]^ [rg> -candTg'' < cg''"^for r > 1, andT/'' > 0]. 
Simultaneous verification of these inequalities yields po - x/k. 

□ 

Using again Lyapunov functions of the form f = h^^we can show that the 
drift of the chain in the transient case can be controlled by two 0-critically tran- 
sient Lamperti processes in the variable || x|| that are uniformly comparable. We 
can thus show, using methods developed in §3.1 the following 

Proposition 3.6. Letx < (hence the chain is transient). 

1. If there exist a constant di > and an arbitary integer I > such that 
Yx ^ rfill-^i^ll-f'zdl-^i^lDln^/) \\x\\, for some arbitrarily small K > 0, then the chain 
explodes. 

2. If there exist a constant d2>0 and an arbitary integer Z > such thatYx ^ 
rfzll-^i^ll-f'zdl.^i^ll); then the chain does not explode. 

With the help of similar arguments we can show the following 

Proposition 3.7. LetO < % (hence the chain is recurrent). 

1. If there exist a constant di > Q and an arbitrary integer I > such that 
Yx ^ dilUII-f'/dUIDln^;) \\x\\, for some arbitrarily small K > 0, then thechain 
implodes. 

2. If there exist a constant dz > and an arbitrary integer I > such that 
Yx - dzWxWLiiWxW), then thechain does not implode. 
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3.4 Collection of one- dimensional complexes 



We introduce some simple models to illustrate two phenomena: 

- it is possible to have < P^CC < oo) < 1, 

- it is possible to have P^CC = co) = and Ex( = oo. 

The simplest situation corresponds to a continuous-time Markov chain whose 
embedded chain is a simple transient random walk on X = Z with non trivial tail 
boundary. For instance, choose some p e]l/2,l[ and transition matrix 

1/2 ifx = 0,y = x±l; 

p _ p ifx>0,y = x+lorx<0,y = x-l; 

I l-p ifx>0,y = x-lorx<0,y = x+l; 

otherwise. 



Then, for every x 7^ 0, < P^C^o = oo) < 1- Suppose now that jx - c for x < 
while there exists a sufficiently large integer / > and an arbitrarily small 5 >0 
such that jx ^ cL; (x)ln^^j x for x > xq. Then, using theorem 1.7, we establish 
that EjcCCItz^ > < 00 for all x > while Pxi( = oo|tz+ = 00) = 1 for all x < 0. 
This result combined with irreducibility of the chain leads to the conclusion: 
< ¥xi( < 00) < 1 for all X G X. 

It is worth noting that bending the axis Z at allows considering the state 
space as the gluing of two one-dimensional complexes X2 = {0} u N x {-,+}; 
every point x g Z \ {0} is now represented as x = (|x|, sgn (x)). This construction 
can be generalised by gluing a denumerably infinite family of one-dimensional 
complexes through a particular point o and introducing the state space Xoo = 
{0} u N X N; every point x g Xoo \ {0} can be represented as x = (xi , X2) with Xi , X2 g 
N. 

Let (<f f) fe[o,oo[ be a continuous time Markov chain evolving on the state space 
Xoo. Its embedded (at the moments of jumps) chain i^n)neN has transition mat- 
rix given by 

jty^ ifx = o,y=(l,y2),y2GN, 

p ifX- (Xi,X2),y= (Xi + l,X2),Xi > 1,X2GN, 

l-p if X= (Xi,X2),y= (Xi-l,X2),Xi > l,X2Gl\J, 

l-p ifx= (l,X2),nGl\l,y = o, 
otherwise. 



Pxy 



where 1/2 < p < 1 andn = (7r„)„eN is a probability vector on N, satisfying 7r„ > 
for all n. The chain is obviously irreducible and transient. 

The space Xoo must be thought as a "mock-tree" since, for transient Markov 
chains, it has a sufficiently rich boundary structure without any of the complic- 
ations of the homogeneous tree (the study on full-fledged trees is postponed in 
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a subsequent publication). Suppose that for every neN there exist an integer 
Z„ > 0, a real 5„ > 0, and a > such that for x = (xi, X2) g N x N for Xi large 

enough, jx satisfies Tix^xz] = Kx^&iLu (-^i) In,/' , Xi). 

By applying theorem 1.7, we establish that •= '^(xi.xa) (Cl^o = 00) < 00 for 
all Xl > and all X2 g N, hence ^(xi.xa) (C = oo|To = 00) = 0. Irreducibility implies 
then that Po(C = 00) = 0. However, 

^ 2p-\ ^ 

X2eN X2eN 

Since the sequences (/„)„, and (i<r„)„ are totally arbitrary, while the pos- 
itive sequence (:/r„)„ must solely satisfy the probability constraint L«eN ^« = 1. 
all possible behaviour for EqC can occur. In particular, we can choose, for all 
n G N, Z,j = and 5„ = 1; this choice gives J{xx,n) = Kn0{\) for every n and for 

Xj 

large Xi, leading to the estimate Zn > CKn, for all n. 

Choosing now, for instance, nn-&il/ n^) and Kn - ©{n) for large n, we get 

Po(C = 00) = and EoC = 00. 

This remark leads naturally to the question whether for transient explod- 
ing chains with non-trivial tail boundary, there exists some critical q > Q such 
that E(^P) < 00 for p < q while ^iC^) - 00 for p > q. Such models include con- 
tinuous time random walks on the homogeneous tree and more generally on 
non-amenable groups. These questions are currently under investigation and 
are postponed to a subsequent publication. 
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